Current state of scientific evidence on Internet-based interventions for the treatment of depression, anxiety, eating disorders and substance abuse: An overview of systematic reviews and meta-analyses

BACKGROUND: ICare represents a consortium of European Investigators examining the effects of online mental health care for a variety of common mental health disorders provided in a variety of settings. This article provides an overview of the evidence of effectiveness for Internet-based treatment for four common mental health disorders that are the focus of much of this work: depression, anxiety, substance abuse and eating disorders. METHODS: The overview focused primarily on systematic reviews and meta-analyses identified through PubMed (Ovid) and other databases and published in English. Given the large number of reviews specific to depression, anxiety, substance abuse and/or eating disorders, we did not focus on reviews that examined the effects of Internet-based interventions on mental health disorders in general. Each article was reviewed and summarized by one of the senior authors, and this review was then reviewed by the other senior authors. We did not address issues of prevention, cost-effectiveness, implementation or dissemination, as these are addressed in other reviews in this supplement. RESULTS: Across Internet-based intervention studies addressing depression, anxiety, substance abuse and eating disorders primarily among adults, almost all reviews and meta-analyses found that these interventions successfully reduce symptoms and are efficacious treatments. Generally, effect sizes for Internet-based interventions treating eating disorders and substance abuse are lower compared with interventions for depression and anxiety. CONCLUSIONS: Given the effectiveness of Internet-based interventions to reduce symptoms of these common mental health disorders, efforts are needed to examine issues of how they can be best disseminated and implemented in a variety of health care and other settings

A framework for applying natural language processing in digital health interventions

BACKGROUND: Digital health interventions (DHIs) are poised to reduce target symptoms in a scalable, affordable, and empirically supported way. DHIs that involve coaching or clinical support often collect text data from 2 sources: (1) open correspondence between users and the trained practitioners supporting them through a messaging system and (2) text data recorded during the intervention by users, such as diary entries. Natural language processing (NLP) offers methods for analyzing text, augmenting the understanding of intervention effects, and informing therapeutic decision making. OBJECTIVE: This study aimed to present a technical framework that supports the automated analysis of both types of text data often present in DHIs. This framework generates text features and helps to build statistical models to predict target variables, including user engagement, symptom change, and therapeutic outcomes. METHODS: We first discussed various NLP techniques and demonstrated how they are implemented in the presented framework. We then applied the framework in a case study of the Healthy Body Image Program, a Web-based intervention trial for eating disorders (EDs). A total of 372 participants who screened positive for an ED received a DHI aimed at reducing ED psychopathology (including binge eating and purging behaviors) and improving body image. These users generated 37,228 intervention text snippets and exchanged 4285 user-coach messages, which were analyzed using the proposed model. RESULTS: We applied the framework to predict binge eating behavior, resulting in an area under the curve between 0.57 (when applied to new users) and 0.72 (when applied to new symptom reports of known users). In addition, initial evidence indicated that specific text features predicted the therapeutic outcome of reducing ED symptoms. CONCLUSIONS: The case study demonstrates the usefulness of a structured approach to text data analytics. NLP techniques improve the prediction of symptom changes in DHIs. We present a technical framework that can be easily applied in other clinical trials and clinical presentations and encourage other groups to apply the framework in similar contexts

Effectiveness of a digital cognitive behavior therapy-guided self-help intervention for eating disorders in college women: A cluster randomized clinical trial

Importance: Eating disorders (EDs) are common, serious psychiatric disorders on college campuses, yet most affected individuals do not receive treatment. Digital interventions have the potential to bridge this gap. Objective: To determine whether a coached, digital, cognitive behavior therapy (CBT) intervention improves outcomes for college women with EDs compared with referral to usual care. Design, Setting, and Participants: This cluster randomized trial was conducted from 2014 to 2018 at 27 US universities. Women with binge-purge EDs (with both threshold and subthreshold presentations) were recruited from enrolled universities. The 690 participants were followed up for up to 2 years after the intervention. Data analysis was performed from February to September 2019. Interventions: Universities were randomized to the intervention, Student Bodies-Eating Disorders, a digital CBT-guided self-help program, or to referral to usual care. Main Outcomes and Measures: The main outcome was change in overall ED psychopathology. Secondary outcomes were abstinence from binge eating and compensatory behaviors, as well as ED behavior frequencies, depression, anxiety, clinical impairment, academic impairment, and realized treatment access. Results: A total of 690 women with EDs (mean [SD] age, 22.12 [4.85] years; 414 [60.0%] White; 120 [17.4%] Hispanic; 512 [74.2%] undergraduates) were included in the analyses. For ED psychopathology, there was a significantly greater reduction in the intervention group compared with the control group at the postintervention assessment (β [SE], -0.44 [0.10]; d = -0.40; t1387 = -4.23; P \u3c .001), as well as over the follow-up period (β [SE], -0.39 [0.12]; d = -0.35; t1387 = -3.30; P \u3c .001). There was not a significant difference in abstinence from any ED behaviors at the postintervention assessment (odds ratio, 1.48; 95% CI, 0.48-4.62; P = .50) or at follow-up (odds ratio, 1.51; 95% CI, 0.63-3.58; P = .36). Compared with the control group, the intervention group had significantly greater reductions in binge eating (rate ratio, 0.82; 95% CI, 0.70-0.96; P = .02), compensatory behaviors (rate ratio, 0.68; 95% CI, 0.54-0.86; P \u3c .001), depression (β [SE], -1.34 [0.53]; d = -0.22; t1387 = -2.52; P = .01), and clinical impairment (β [SE], -2.33 [0.94]; d = -0.21; t1387 = -2.49; P = .01) at the postintervention assessment, with these gains sustained through follow-up for all outcomes except binge eating. Groups did not differ in terms of academic impairment. The majority of intervention participants (318 of 385 participants [83%]) began the intervention, whereas only 28% of control participants (76 of 271 participants with follow-up data available) sought treatment for their ED (odds ratio, 12.36; 95% CI, 8.73-17.51; P \u3c .001). Conclusions and Relevance: In this cluster randomized clinical trial comparing a coached, digital CBT intervention with referral to usual care, the intervention was effective in reducing ED psychopathology, compensatory behaviors, depression, and clinical impairment through long-term follow-up, as well as realizing treatment access. No difference was found between the intervention and control groups for abstinence for all ED behaviors or academic impairment. Given its scalability, a coached, digital, CBT intervention for college women with EDs has the potential to address the wide treatment gap for these disorders. Trial Registration: ClinicalTrials.gov Identifier: NCT02076464

Passive Sensor Data for Characterizing States of Increased Risk for Eating Disorder Behaviors in the Digital Phenotyping Arm of the Binge Eating Genetics Initiative: Protocol for an Observational Study

BackgroundData that can be easily, efficiently, and safely collected via cell phones and other digital devices have great potential for clinical application. Here, we focus on how these data could be used to refine and augment intervention strategies for binge eating disorder (BED) and bulimia nervosa (BN), conditions that lack highly efficacious, enduring, and accessible treatments. These data are easy to collect digitally but are highly complex and present unique methodological challenges that invite innovative solutions. ObjectiveWe describe the digital phenotyping component of the Binge Eating Genetics Initiative, which uses personal digital device data to capture dynamic patterns of risk for binge and purge episodes. Characteristic data signatures will ultimately be used to develop personalized models of eating disorder pathologies and just-in-time interventions to reduce risk for related behaviors. Here, we focus on the methods used to prepare the data for analysis and discuss how these approaches can be generalized beyond the current application. MethodsThe University of North Carolina Biomedical Institutional Review Board approved all study procedures. Participants who met diagnostic criteria for BED or BN provided real time assessments of eating behaviors and feelings through the Recovery Record app delivered on iPhones and the Apple Watches. Continuous passive measures of physiological activation (heart rate) and physical activity (step count) were collected from Apple Watches over 30 days. Data were cleaned to account for user and device recording errors, including duplicate entries and unreliable heart rate and step values. Across participants, the proportion of data points removed during cleaning ranged from <0.1% to 2.4%, depending on the data source. To prepare the data for multivariate time series analysis, we used a novel data handling approach to address variable measurement frequency across data sources and devices. This involved mapping heart rate, step count, feeling ratings, and eating disorder behaviors onto simultaneous minute-level time series that will enable the characterization of individual- and group-level regulatory dynamics preceding and following binge and purge episodes. ResultsData collection and cleaning are complete. Between August 2017 and May 2021, 1019 participants provided an average of 25 days of data yielding 3,419,937 heart rate values, 1,635,993 step counts, 8274 binge or purge events, and 85,200 feeling observations. Analysis will begin in spring 2022. ConclusionsWe provide a detailed description of the methods used to collect, clean, and prepare personal digital device data from one component of a large, longitudinal eating disorder study. The results will identify digital signatures of increased risk for binge and purge events, which may ultimately be used to create digital interventions for BED and BN. Our goal is to contribute to increased transparency in the handling and analysis of personal digital device data. Trial RegistrationClinicalTrials.gov NCT04162574; https://clinicaltrials.gov/ct2/show/NCT04162574 International Registered Report Identifier (IRRID)DERR1-10.2196/3829

Sociodemographic and clinical characteristics of treated and untreated adults with bulimia nervosa or binge-eating disorder recruited for a large-scale research study

Abstract Background Eating disorders affect millions of people worldwide, but most never receive treatment. The majority of clinical research on eating disorders has focused on individuals recruited from treatment settings, which may not represent the broader population of people with eating disorders. This study aimed to identify potential differences in the characteristics of individuals with eating disorders based on whether they self-reported accessing treatment or not, in order to contribute to a better understanding of their diverse needs and experiences. Methods The study population included 762 community-recruited individuals (85% female, M ± SD age = 30 ± 7 years) with bulimia nervosa or binge-eating disorder (BN/BED) enrolled in the Binge Eating Genetics Initiative (BEGIN) United States study arm. Participants completed self-report surveys on demographics, treatment history, past and current eating disorder symptoms, weight history, and their current mental health and gastrointestinal symptoms. Untreated participants (n = 291, 38%) were compared with treated participants (n = 471, 62%) who self-reported accessing BN/BED treatment at some point in their lives. Results Untreated participants disproportionately self-identified as male and as a racial or ethnic minority compared with treated participants. Treated participants reported a more severe illness history, specifically, an earlier age at onset, more longstanding and frequent eating disorder symptoms over their lifetime, and greater body dissatisfaction and comorbid mental health symptoms (i.e., depression, anxiety, ADHD) at the time of the study. A history of anorexia nervosa was positively associated with treatment engagement. Individuals self-reporting a history of inpatient or residential treatment exhibited the most severe illness history, those with outpatient treatment had a less severe illness history, and untreated individuals had the mildest illness history. Conclusions Historically overlooked and marginalized populations self-reported lower treatment access rates, while those who accessed treatment reported more severe eating disorder and comorbid mental health symptoms, which may have motivated them to seek treatment. Clinic-based recruitment samples may not represent individuals with milder symptoms or racial and ethnic diversity, and males. Community-based recruitment is crucial for improving the ability to apply research findings to broader populations and reducing disparities in medical research. Trial Registration ClinicalTrials.gov NCT04162574 ( https://clinicaltrials.gov/ct2/show/NCT04162574 )

Retention, Engagement, and Binge-Eating Outcomes: Evaluating Feasibility of the Binge-Eating Genetics Initiative Study

OBJECTIVE: Using preliminary data from the Binge-Eating Genetics Initiative (BEGIN), we evaluated the feasibility of delivering an eating disorder digital app, Recovery Record, through smartphone and wearable technology for individuals with binge-type eating disorders. METHODS: Participants (n = 170; 96% female) between 18 and 45 years old with lived experience of binge-eating disorder or bulimia nervosa and current binge-eating episodes were recruited through the Recovery Record app. They were randomized into a Watch (first-generation Apple Watch + iPhone) or iPhone group; they engaged with the app over 30 days and completed baseline and endpoint surveys. Retention, engagement, and associations between severity of illness and engagement were evaluated. RESULTS: Significantly more participants in the Watch group completed the study (p = .045); this group had greater engagement than the iPhone group (p\u27s \u3c .05; pseudo-R effect size = .01-.34). Overall, binge-eating episodes, reported for the previous 28 days, were significantly reduced from baseline (mean = 12.3) to endpoint (mean = 6.4): most participants in the Watch (60%) and iPhone (66%) groups reported reduced binge-eating episodes from baseline to endpoint. There were no significant group differences across measures of binge eating. In the Watch group, participants with fewer episodes of binge eating at baseline were more engaged (p\u27s \u3c .05; pseudo-R = .01-.02). Engagement did not significantly predict binge eating at endpoint nor change in binge-eating episodes from baseline to endpoint for both the Watch and iPhone groups. DISCUSSION: Using wearable technology alongside iPhones to deliver an eating disorder app may improve study completion and app engagement compared with using iPhones alone

Prospective observational cohort study on grading the severity of postoperative complications in global surgery research

Background The Clavien–Dindo classification is perhaps the most widely used approach for reporting postoperative complications in clinical trials. This system classifies complication severity by the treatment provided. However, it is unclear whether the Clavien–Dindo system can be used internationally in studies across differing healthcare systems in high- (HICs) and low- and middle-income countries (LMICs). Methods This was a secondary analysis of the International Surgical Outcomes Study (ISOS), a prospective observational cohort study of elective surgery in adults. Data collection occurred over a 7-day period. Severity of complications was graded using Clavien–Dindo and the simpler ISOS grading (mild, moderate or severe, based on guided investigator judgement). Severity grading was compared using the intraclass correlation coefficient (ICC). Data are presented as frequencies and ICC values (with 95 per cent c.i.). The analysis was stratified by income status of the country, comparing HICs with LMICs. Results A total of 44 814 patients were recruited from 474 hospitals in 27 countries (19 HICs and 8 LMICs). Some 7508 patients (16·8 per cent) experienced at least one postoperative complication, equivalent to 11 664 complications in total. Using the ISOS classification, 5504 of 11 664 complications (47·2 per cent) were graded as mild, 4244 (36·4 per cent) as moderate and 1916 (16·4 per cent) as severe. Using Clavien–Dindo, 6781 of 11 664 complications (58·1 per cent) were graded as I or II, 1740 (14·9 per cent) as III, 2408 (20·6 per cent) as IV and 735 (6·3 per cent) as V. Agreement between classification systems was poor overall (ICC 0·41, 95 per cent c.i. 0·20 to 0·55), and in LMICs (ICC 0·23, 0·05 to 0·38) and HICs (ICC 0·46, 0·25 to 0·59). Conclusion Caution is recommended when using a treatment approach to grade complications in global surgery studies, as this may introduce bias unintentionally

The surgical safety checklist and patient outcomes after surgery: a prospective observational cohort study, systematic review and meta-analysis

© 2017 British Journal of Anaesthesia Background: The surgical safety checklist is widely used to improve the quality of perioperative care. However, clinicians continue to debate the clinical effectiveness of this tool. Methods: Prospective analysis of data from the International Surgical Outcomes Study (ISOS), an international observational study of elective in-patient surgery, accompanied by a systematic review and meta-analysis of published literature. The exposure was surgical safety checklist use. The primary outcome was in-hospital mortality and the secondary outcome was postoperative complications. In the ISOS cohort, a multivariable multi-level generalized linear model was used to test associations. To further contextualise these findings, we included the results from the ISOS cohort in a meta-analysis. Results are reported as odds ratios (OR) with 95% confidence intervals. Results: We included 44 814 patients from 497 hospitals in 27 countries in the ISOS analysis. There were 40 245 (89.8%) patients exposed to the checklist, whilst 7508 (16.8%) sustained ≥1 postoperative complications and 207 (0.5%) died before hospital discharge. Checklist exposure was associated with reduced mortality [odds ratio (OR) 0.49 (0.32–0.77); P\u3c0.01], but no difference in complication rates [OR 1.02 (0.88–1.19); P=0.75]. In a systematic review, we screened 3732 records and identified 11 eligible studies of 453 292 patients including the ISOS cohort. Checklist exposure was associated with both reduced postoperative mortality [OR 0.75 (0.62–0.92); P\u3c0.01; I2=87%] and reduced complication rates [OR 0.73 (0.61–0.88); P\u3c0.01; I2=89%). Conclusions: Patients exposed to a surgical safety checklist experience better postoperative outcomes, but this could simply reflect wider quality of care in hospitals where checklist use is routine

Critical care admission following elective surgery was not associated with survival benefit: prospective analysis of data from 27 countries

This was an investigator initiated study funded by Nestle Health Sciences through an unrestricted research grant, and by a National Institute for Health Research (UK) Professorship held by RP. The study was sponsored by Queen Mary University of London